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Abstract 

We present a unified analytical framework within which power control, rate allocation, routing, and 
c/3 , congestion control for wireless networks can be optimized in a coherent and integrated manner We 

O . 

consider a multi-commodity flow model with an interference-limited physical-layer scheme in which 



(N 



O 

C/2 



power control and routing variables are chosen to minimize the sum of convex link costs reflecting, 
\ for instance, queuing delay. Distributed network algorithms where joint power control and routing are 

ly-^ , performed on a node-by-node basis are presented. We show that with appropriately chosen parameters, 

I these algorithms iteratively converge to the global optimum from any initial point with finite cost. Next, 

I we study refinements of the algorithms for more accurate link capacity models, and extend the results 

to wireless networks where the physical-layer achievable rate region is given by an arbitrary convex 
set, and the link costs are strictly quasiconvex. Finally, we demonstrate that congestion control can be 
O ■ seamlessly incorporated into our framework, so that algorithms developed for power control and routing 

can naturally be extended to optimize user input rates. 

I. Introduction 

In wireless networks, link capacities are variable quantities determined by transmission powers, 
channel fading levels, user mobility, as well as the underlying coding and modulation schemes. 
In view of this, the traditional problems of routing and congestion control must now be jointly 
optimized with power control and rate allocation at the physical layer. Moreover, the inherent 
decentralized nature of wireless networks mandates that distributed network algorithms requiring 
limited communication overhead be developed to implement this joint optimization. In this paper, 
we present a unified analytical framework within which power control, rate allocation, routing, 

'This research is supported in part by Army Research Office (ARC) Young Investigator Program (YIP) grant DAAD19-03- 
1-0229 and by National Science Foundation (NSF) grant CCR-0313183. 
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and congestion control for wireless networks can be optimized in a coherent and integrated 
manner. We then develop a set of distributed network algorithms which iteratively converge to a 
jointly optimal operating point. These algorithms operate on the basis of marginal-cost message 
exchanges, and are adaptive to changes in network topology and traffic patterns. The algorithms 
are shown to have superior performance relative to existing wireless network protocols. 

The development of network optimization began with the study of traffic routing in wireline 
networks. Elegant frameworks for optimal routing within a multi-commodity flow setting are 
given in [1], [2]. A distributed routing algorithm based on gradient projection is developed [2], 
where all nodes iteratively adjust their traffic allocation for each type of traversing flow. This 
algorithm is generalized in [3], where estimates of second derivatives of the cost function are 
utilized to improve the convergence rate. 

With the advent of variable-rate communications, congestion control in wireline networks 
has become an important topic of investigation. In [4]-[7], congestion control is optimized 
by maximizing the utilities of contending sessions with elastic rate demands subject to link 
capacity constraints. Distributed algorithms where sources adjust input rates based on price 
signal feedback from links are shown to converge to the optimal operating point. These results 
have been extended in [8]-[10], where combined congestion control and routing (both single- 
path and multi-path) algorithms are developed. The above-mentioned papers generally consider 
source routing, where it is assumed that all available paths to the destinations are known a priori 
at the source node, which makes the routing decisions. 

Wireless networks differ fundamentally from wireline networks in that link capacities are 
variable quantities that can be controlled by adjusting transmission powers. The power control 
problem has been most extensively studied for CDMA wireless networks. Previous work at the 
physical layer [1 1]-[16] has generally focused on developing distributed algorithms to achieve the 
optimal trade-off between transmission power levels and Signal-to-Interference-plus-Noise-Ratios 
(SINR). More recently, cross-layer optimization for wireless networks has been investigated 
in [15], [17], [18]. In particular, the work in [19] develop distributed algorithms to accomplish 
joint optimization of the physical and transport layers within a CDMA context. 

In this work, we present a unified framework in which the power control, rate allocation, 
routing, and congestion control functionalities at the physical. Medium Access Control (MAC), 
network, and transport layers of the wireless network can be jointly optimized. We focus on 
quasi-static network scenarios where user traffic statistics and channel conditions vary slowly. 
We adopt a multi-commodity flow model and pose a general problem in which capacity allocation 
and routing are jointly optimized to minimize the sum of convex link costs reflecting, for instance, 
queuing delay in the network. To be specific, we focus initially on an interference-limited wireless 
networks where the link capacity is a concave function of the link SINR. For these networks. 
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power control and routing variables are chosen to minimize the total network cost. In view of 
frequent changes in wireless network topology and node activity, it may not be practical nor 
even desirable for sources to obtain full knowledge of all available paths. We therefore focus 
on distributed schemes where joint power control and routing is performed on a node-by-node 
basis. Each node decides on its total transmission power as well as the power allocation and 
traffic allocation on its outgoing links based on a limited number of control messages from other 
nodes in the network. 

We first establish a set of necessary and sufficient conditions for the joint optimality of a 
power control and routing configuration. We then develop a class of node-based scaled gradient 
projection algorithms employing first derivative marginal costs which can iteratively converge to 
the optimal operating point, without knowledge of global network topology or traffic patterns. 
For rapid and guaranteed convergence, we develop a new set of upper bounds on the matrices 
of second derivatives to scale the direction of descent. We explicitly demonstrate how the 
algorithms' parameters can be determined by individual nodes using limited communication 
overhead. The iterative algorithms are rigorously shown to rapidly converge to the optimal 
operating point from any initial configuration with finite cost. 

After developing power control and routing algorithms for specific interference-limited sys- 
tems, we consider wireless networks with more general coding/modulation schemes where the 
physical-layer achievable rate region is given by an arbitrary convex set. The necessary and 
sufficient conditions for the joint optimality of a capacity allocation and routing configuration are 
characterized within this general context. Under the relaxed requirement that link cost functions 
are only strictly quasiconvex, we show that any operating point satisfying the above conditions 
is Pareto optimal. 

Next, we show that congestion control for users with elastic rate demands can be seamlessly 
incorporated into our analytical framework. We consider maximizing the aggregate session utility 
minus the total network cost. It is shown that with the introduction of virtual overflow links, 
the problem of jointly optimizing power control, routing, and congestion control can be made 
equivalent to a problem involving only power control and routing in a virtual wireless network. 
In this way, the distributed algorithms previously developed for power control and routing can 
be naturally extended to this more general setting. 

Finally, we present results from numerical experiments. The results confirm the superior perfor- 
mance of the proposed network control algorithms relative to that of existing wireless network 
protocols such as the Ad hoc On Demand Distance Vector (AODV) routing algorithm [20]. 
Our algorithms are shown to converge rapidly to the optimal operating point. Moreover, the 
algorithms can adaptively chase the shifting optimal operating point in the presence of slow 
changes in the network topology and traffic conditions. Finally, the algorithms exhibit reasonably 
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good convergence even with delayed and noisy control messages. 

The paper is organized as follows. The basic system model and the jointly optimal capacity 
allocation and routing problem formulation are described in Section |Ill In Section |llll we 
specify the jointly optimal power control and routing problem in node-based form for an 
interference-limited wireless network. In Section |IVl the necessary and sufficient conditions 
for optimality are presented and proved. In Section |Vl we present a class of scaled gradient 
projection algorithms and characterize the appropriate algorithm parameters for convergence to 
the optimum. In Section |VIl we develop network control schemes for more refined link capacity 
models and derive optimality results for general convex capacity regions and quasi-convex cost 
functions. Section IVIII extends the algorithms to incorporate congestion control mechanisms. 
Finally, results of relevant numerical experiments are shown in Section IVIIII 



II. Network Model and Problem Formulation 



A. Network Model, Capacity Region, and Flow Model 

Let the multi-hop wireless network be modelled by a directed and (strongly) connected graph 
Q = (A/", £), where J\f and £ are the node and link sets, respectively. A node i E M represents a 
wireless transceiver containing a transmitter with individual power constraint and a receiver 
with additive white Gaussian noise (AWGN) of power Ni. A link (i^) G £ corresponds to a 
unidirectional link, which models a radio channel from node z to jo For G £, let 

denote its capacity (in bits/sec). In a wireless network, the value of Cij is variable (we address 
this issue in depth below). 

A link capacity vector C = (C'jj)(i,j)e£ is feasible if it lies in a given achievable rate region 
C C My, which is determined, for example, by the network coding/decoding scheme and the 
nodes' transmission powers. In the following, we will first consider the specific rate region 
induced by a CDMA-based network model and then study the more general case of arbitrary 
convex rate regions in Section IVI-BI 

Consider a collection W of communication sessions, each identified by its source-destination 
node pair. We adopt a flow model [21] to analyze the transmission of the sessions' data inside the 
network. The flow model is reasonable for networks where the traffic statistics change slowly 
over timeO As we show, the flow model is particularly amenable to cost minimization and 
distributed computation. 

^We think of £ as being predetermined by the communication system setup. For instance, in a CDMA system, £ f if 

node j knows the spreading code used by i. 

^Such is the case when each session consists of a large number of independent data streams modelled by stochastic arrival 
processes, and no individual process contributes significantly to the aggregate session rate [21]. 
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For any session w G W, let 0{w) and D{w) denote the origin and destination nodes, respec- 
tively. Denote session w's flow rate on link (i, j) by fij{w). For now, assume the total incoming 
rate of session w is a positive constant r^jU Thus, we have the following flow conservation 
relations. For all w E W, 

^•H>o, V(z,j)ef, 

^ fij{w) = = ti{w), i = 0{w), 



(1) 



fijH = 0, t = D{w) and Vj G 0{i), 

where 0(2) = {j : (i, j) G £} and J(i) = {j : (j, i) G Here, ti{w) denotes the total incoming 
rate of session w's traffic at node i. Finally, the total flow rate on a link is the sum of flow rates 
of all the sessions using that link: 

Fij= $^/i.H, ^{i,j)e£. (2) 



B. Impact of Traffic Flow and Link Capacities on Network Cost 

We assume the network cost is the sum of costs on all the links|f| The cost on link (i, j) is 
given by a function Dij(Cij, Fij) of the capacity Cij and the total flow rate Fij. We assume that 
Dij{Cij, Fij) is increasing and convex in Fij for each Cij, and decreasing and convex in Cij for 
each Fij. The link cost function Dij{Cij, Fij) can represent, for instance, the expected delay in 
the queue served by link {i,j) with arrival rate Fij and service rate While the mono tonicity 
of Dij is easy to see, the convexity of Dij in Fij and Cij follows from the fact that the expected 
queuing delay increases with the variance of the arrival and/or service times |3 

For analytical purposes, Dij(Cij, F^j) is further assumed to be twice continuously differentiable 
in the region X = {{Cij, Fij) : < Fij < Cij}. Moreover, to implicitly impose the link capacity 

*Later in Section [Vlll we will consider elastic sessions with variable incoming rate. 

^If costs also exist at nodes, they can be absorbed into the costs of the nodes' adjacent links. 

*Note that when dj is fixed, Dij{Cij, •) reduces to the flow-dependent delay function considered in past literature on optimal 
routing in wireline networks [2], [3], [22]. 

^This phenomenon is captured by the heavy traffic mean formula for a GI/GI/1 queue with random service time X and arrival 
time A. The expected waiting time is given by 

pmn + pel - p(l - p) 
^[^1 2K^) • 

Here, A denotes the average arrival rate, p = \E[X], d = \M[X]/E[Xf and d = waT[A]/E[Af. 
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Fig. 1. Session 1 originates from node i and ends at node I. Session 2, originating elsewhiere in tlie network and destined also 
for node I, enters this part of the network at nodes i and k. Node i routes session 1 to j, k, and I, and routes session 2 to 
j and I. Node k forwards session 2 directly to /. These individual flows make up the total flows on the links. Link costs are 
determined by the flow rates and capacities. 



constraint, we assume Dij{Cij, Fij) ^ oo as Fij —>■ C^j and Dij{Cij, Fij) = oo for Fij > Cij. 
To summarize, for all (i, j) G 8, the cost function Dij : M_|_ x IR+ ^ ]R_|_ satisfies 

dDi, dDii d^Di. d^Dii 

^ < 0, — ^ > 0, — f > 0, > 0, if G X, (3) 

dCij dFij dCf^ dFl- 



and Dij{Cij, Fij) = oo otherwise. As an example§ 



D,,iC.„ F,,) = , for < F,, < (4) 

gives the expected number of packets waiting for or under transmission at link under an 
M/M/1 queuing model. Summing over all links, the network cost X](t j) Dij{Cij, Fij) gives the 
average number of packets in the network^ As another example, Dij = I /{Cij — F^j) gives the 
average waiting time of a packet in an M/M/1 queuing model. The network model and cost 
functions are illustrated in Figure [B 

*To be precise, an infinitesimal term e needs to be added to the numerator, i.e., Dij = [Fij +e)/{Cij — Fij), to make 
ODij/dCij < for Fij = 0. 

'By the Kleinrock independence approximation and Jackson's Theorem, the M/M/1 queue is a good approximation for the 
behavior of individual links when the system involves Poisson stream arrivals at the entry points, a densely connected network, 
and moderate-to-heavy traffic load [21], [23]. 
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C. Basic Optimization Problem: Capacity Allocation and Routing 

We now formulate the main Jointly Optimal Capacity allocation and Routing (JOCR) problem, 
which involves adjusting {fij{w)} and {C-ij} jointly to minimize total network cost as follows: 

minimize ^ Dij{Cij,Fij) (5) 
(i,i)6£- 

subject to flow conservation constraints in © — 0, 

C eC. (6) 

The central concern of this paper is the development of distributed algorithms to solve the JOCR 
problem in useful network contexts. 

III. Optimal Distributed Routing and Power Control 
A. Node-Based Routing 

To solve the JOCR problem, we first investigate distributed routing schemes for adapting 
link flow rates. In previous literature, there have been extensive discussion of multi-path source 
routing methods in wireline networks [9], [10], [24]. In these methods, source nodes are assumed 
to have comprehensive information about all available paths through the network to their destina- 
tions. In contrast to wireline networks, however, wireless networks are characterized by frequent 
node activity and network topology changes. In these circumstances, it may not be practical nor 
even desirable to implement source routing, which requires source nodes to constantly obtain 
current path information. We therefore focus on distributed schemes where routing is performed 
on a node-by-node basis [2]. In essence, these schemes distribute routing decisions to all nodes 
in the network, rather than concentrating them at source nodes only. As we show, neither source 
nodes nor intermediate nodes are required to know the topology of the entire network. Nodes 
interact only with their immediate neighbors. 

To make distributed adjustment possible, we adopt the routing variables introduced by Gallager 
[2] . They are defined for alH G A/" and w eW in terms of link flow fractions as 

Routing variables: (j)ij{w) = J e 0{i). (7) 

The flow conservation constraints ([T]) are translated into the space of routing variables as 

M'^) > 0, Vj e 0{i), 
J2 ^ijM = 1, if i ^ D{w), .o^ 

(f)ij{w) = 0, Vj G 0{i) if i = D{w). 

For node i such that ti{w) = 0, the specific values of (j)ij{wys are immaterial to the actual flow 
rates. They can be assigned arbitrary values satisfying ([8]). 
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The routing variables {(j)ij{w))w^y\;^(^ij)^£ determine the routing pattern and flow distribution 
of the sessions. They can be implemented at each node i using either a deterministic scheme 
(node i routes (t>ij{w) of its incoming session-w traffic to neighbor j) or a random scheme (node 
i forwards session w traffic to j with probability (t)ij{w)). 

B. Power Control and Link Capacity 

After examining the routing issue, we now address the question of capacity allocation. In a 
wireless communication network, given fixed channel conditions, the achievable rate region C is 
determined by the coding/decoding scheme and transmission powers, among other factors. To 
be specific, we focus initially on a wireless network with an interference-limited physical-layer 
scheme. 

Assume the link capacity Cij is a function C{SINRij) of the signal-to-interference-plus-noise 
ratio (SINR) at the receiver of link (i, j), given by 



where Pmn is the transmission power on link (m, n), Gmj denotes the (constant) path gain from 
node m to j, Nj is the noise power at node j's receiver. We further assume C(-) is strictly 
increasing, concave, and twice continuously differentiable. For example, in a spread- spectrum 
CDMA network using (optimal) single-user decoding, the SINR per symbol is K-SINRij where 
K denotes the processing gain [25]. Since K typically is very large, the information-theoretic 
link capacity -y- log(l -|- K ■ SINRij) (in bits/sec) is well approximated as 



where Rg is the (fixed) symbol rate of the CDMA sequence. As another example, if messages 
are modulated on CDMA symbols using M-QAM, and the error probability is required to be 
less than or equal to Pe, then the maximum data rate under the same high-SINR assumption is 
given by [26] 



SINRii = 




a,^^log{K-SINR,j), 



(9) 




(10) 



where Q{-) is the complementary distribution function of a normal random variable. 
Assume that every node is subject to an individual power constraint 




(11) 



Denote the set of feasible power vectors P = {Pij){i,j)££ by 11. 
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We now note that the objective function in ([5]), j) -^iji^iji^)^ ^ij)^ convex in the 
flow variables (Fij). It is convex in P if every Cy is concave in P. Unfortunately, given that 
Cij = C{SINRij) is strictly increasing, V'^Cij{P) cannot be negative definite. However, it is 
observed in [?] that if 

C"(x) ■ X + C\x) < 0, Vx > 0, (12) 

then with a change of variables Smn = InP^^ [19], Cy is concave in 5 = {Smn){m,n)&£- From 
this, it can be verified that the objective function in ([5]) is convex in S. In the following, we 
assume C(-) satisfies (fT2)) . Note that this is true for the capacity functions of the CDMA and 
M-QAM examples above. For brevity, we will sometimes denote SINRij by Xij. We will also 
make use of the log-power variables S (i.e., power measured in dB), which belong to the feasible 

set = {5 G Ml^l : e^'' < P^^' ^ 

As in the case of the routing variables (f)ij{w), it is convenient to express the transmission 
power Pij on link in terms of the power control and power allocation variables as follows: 

p. . 

Power allocation variables: r]ij = {i,j)E£, (13) 

i 

In P 

Power control variables: = — i G J\f. (14) 

In Pi 

With appropriate scaling, we can always let all Pj > 1 so that the constraints for rjij and 7^ 
can be written as follows: 

V^J > 0, V(2, j) eS, Yl = 1' 7* < 1, G Af. (15) 

C. Distributed Optimization Problem: Power Control and Routing 

With definitions ©, (fT3l) . and (fT4l) . the JOCR problem in ([5]) can be expressed in node-based 
form. We call this the Jointly Optimal Power Control and Routing (JOPR) problem: 

minimize Dij ( Cij , Pij) (16) 

subject to dS]), ([B]), (17) 
where link flow rates and capacities are determined b)0 

Fij = 5^t,H-0,,H, yit,j)e£, (18) 

'"Notice that in general, dj should be upper bounded by the RHS of ( 120b . However, since cost function Dij{-,Fij) is 
decreasing in dj, any solution of problem ((Sjl must allocate a vector of link capacities lying on the boundary of C. Therefore, 
without loss of optimality, we assume equality in ( I20t . 
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ti{w) 



r^, i = 0{w) 

J2 t,H-0,.H, v^^oH ' 



( 



Cij — c 



^ij ( ) ^'^ Vij 



\ 



(19) 



(20) 



IV. Conditions for Optimality 

To specify the optimality conditions for the JOPR problem in (fT6l) . it is necessary to compute 
the cost gradients with respect to the routing variables, the power allocation variables, and the 
power control variables, respectively. For the routing variables, the gradients are given in [2] as 

dD 



d(f)ij{w) 



where the marginal routing cost is 



6(j)ij{w} = TTTT^ + 



drj{w) 



(21) 



(22) 



Here, stands for the marginal cost due to a unit increment of session w's input traffic at 

j. It is computed recursively by [2] 

dD 



dvj (w) 

dD 
dri{w) 



0, ifj = DH, 



w 



+ 



dD 



dFij drj{w) 



w] 



(23) 

i,{w), Wt ^ D{w). (24) 



We now compute the gradients with respect to the power allocation and power control vari- 
ables: 



dD 

dr]ij 



P, 



117^ 7T?i + 



(m,n) 



dC„ 



(25) 



where is short-hand notation for dC{xmn) /dxmn- Here, the marginal power allocation cost 
is 



dDjj CljGjj 
dCij IN,, 



1 + SINRi 



Finally, the derivatives with respect to the power control variables are given by 

— = 5i ■ d-fi, 
07i 



(26) 



(27) 
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where the marginal power control cost is 

S^i ^ Pi 

The term INij appearing in (l25l) . (|26l) and (|28l) is short-hand notation for the overall interference- 
plus-noise power at the receiver of link (i, j): 

INij = Gij -Pifc + -Pmfc + Nj. 

We will present the methods for providing nodes with the above marginal costs Scpij^w), Srjij 
and ^7;, along with the description of distributed routing and power adjustment algorithms, in 
Section |Vl 

Given the marginal costs S(f)ij{w), 5r]ij, and S'ji, each node can check whether optimality 
is achieved by verifying the conditions stated in the following theorem, which generalizes 
Theorem 2 of Gallager [2] to the wireless setting. 

Theorem 1: Assume the link cost functions Dij(Cij, Fij) satisfy the conditions in ([3]). For a 
feasible set of routing and transmission power allocations {(j)ij{w)}wew,{i,j)ee, {Vij}{i,j)ee and 
{li}i€Af to be the solution of the JOPR problem in (fT6l) . the following conditions are necessary. 
For all w G W and i ^ D{w) with ti{w) > 0, there exists a constant \i{w) such that 

6(j)ij{w) = Xi{w), if (j)ij{w) > 0, (29) 
6(j)i,{w) > Xi{w), if (j)ij{w) = 0. (30) 

For all i E M, all rjij > 0, and there exists a constant z/j such that 







(31) 




if 7* < 1, 


(32) 




if li = 1. 


(33) 



i 



If the link cost functions Dij{Cij, Fij) are also jointly convex in {Cij, Fij), then these conditions 
are sufficient for optimality if (|29l)-(l30l) hold at every i ^ D(w) for all w E W, whether ti{w) > 
or not. 

Note that because Dij{Cij, Fij) is defined to be infinite when Cij = (cf. Section Hl-BI) . we 
must have r]ij > for all E £ at the optimum. Furthermore, note that the sufficiency part 
of Theorem [H requires the cost function Dij{Cij, Fij) to be jointly convex in {Cij, Fij). This 
is true for the cost function Dij = I /{Cij — Fij) for < Fij < Cij, but not true for the cost 



E 

(m,n) 



^Dmn C ^j^G uinC inPmn 



dC„ 



INI. 



+ 



E 



(28) 
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function Dij = Fij/{Cij — Fij). To deal with the latter case, we will establish the conditions for 
a Pareto optimal operating point for strictly quasiconvex cost functions in Section |VI-C[ 
Before presenting the proof of Theorem (TJ we point out a useful identity. 

Lemma 1: With node-based marginal routing costs defined as in (|23] ) and (|24l) . we have 

Eo 7-^ i^ijy ^ij) ' -^ij / , "o 7 \" ' ^"w- (34) 

The proof of the lemma requires only algebraic manipulations. It can be found in Appendix lAl 

Proof of Theorem [U- To prove the necessity of (|29l)-(l30l). suppose it is violated for some 
w at some node i ^ D{w) such that ti{w) > 0. By (|2TI) . there exists link (i, j) such that 

fij{w) = ti{w)(f)ij{w) > and 

dD dD 
> min 



d(f)ij{w) ieo{i) d(f)u{w)' 
Then by shifting a tiny portion of flow of session w from link to a link having minimal 
marginal cost, i.e. any link (z, k) such that k = aigmmi(zo{i) 9^-^^) ' ^^^^^ ^^^^ decreased. 
Thus {(f)ijiw)} cannot be optimal. The necessity of conditions (|3TI)-(|331) can be verified in the 
same way by making use of (|25l) and (|271) . 

To show the sufficiency statement, assume {0*j(w)}^gw,(i,i)6£:' {Vij}{i,j)e£ and {7*}igAr is a 
set of valid routing and power variables that satisfy (|29l)-(l33]). Let {0ij(u^)}«,ew,(t,j)e£j {Vij}(i,j)&£ 
and {'jl}ieAf be any other set of feasible routing and power variables. Denote the resulting link 
flow rates, link capacities and log-powers under these two schemes by {F*j}, {C*j}, {S*^} and 
{Flj}, {Clj}, {Slj}, respectively. Using the convexity of cost functions and summing over all 
(i, j) G S, we have 

E A,(Ci,4)-A,(C-,i^) 

fir) f)T) 

^ E ^) ■ (4 - ^) + E ^) ■ - )• (35) 



We show that the two summations on the RHS of (1351) are both non-negative, thus establishing 
the superiority of [fllj] ^i^d {7*}. We analyze the first summation as follows: 

f) n 

(a) ^ dD^^^. p*^ pi _ dD* 



(i,j)g£ U16VV \ ' ^ 



13 



E 



w] 



^ dD* 1, , 



i=0(M!) 



dri{w) 



(c) 



E I E «."(») 
E 1 E 



drj{w) 



W) 



W] 



E4 

j€0{i) 



dD* 



— (C* F* \ 4- 



.wj - mm 0(p^^[w} 



dD* 



> 



The first equation results from Lemma [T] To obtain (b), we first use the definition of F^j in (fTSl) 
and the fact that t}{w) = r^, G W and i = 0{w). We then append the zero terms (cf. (fT9l) ) 



E 



dD* 
drjiw) 



i^D{w) 



j^O(w),D{w) 

for all w E W. By rearranging terms on the RHS of (b), we get equation (c). The optimality 
conditions (|29l)-(l30l) are translated into equation (d), which immediately results in inequality (e). 
Next, we examine the second summation in (|35] ). Recalling the concavity of Cij in terms of 



(Smn) and noticing that < 0, we can bound the second summation by 



f)n rlD* rir'* 

E——i(r* F*'\ ■ (C^ - C*\ > \^ _!i \^ _!:L('S'i _ Q* 



(36) 



where ^^{C*,, F*-) is abbreviated as and ^^(5*) is abbreviated as ^w^. Differentiating 



CmniS) with respect to each of its variables, we have 



dC„ 



if (i, j) = (m,n), 



tTi i t • 

— — ^, otherwise, 



(37) 



where Xmn denotes SINRmn- We further transform and bound the RHS of (|36l) as 

fir'* / ^ ' V mn ^mn) 



dC*. ^ OS* 



(a) 



E 



i^tln^ 



/ ^ p* «j p* 
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— p* \ p* j 

Here, equality (a) follows from the definition of {5i]ij} and the optimality condition (|3TI) . Using 
the definition of {Sji}, we obtain equality (b). By the conditions (I32l)-(l33]), S'j*/P* < 0. This, 
together with the fact that Ins < x — 1, Vx > 0, yields inequality (c). Summing over all j E 0{i) 
for each i G A/", we obtain (d). The last inequality (e) is implied by conditions (I32l)-(l33l) as well. 

We have shown that A,(Ci, F^) " A,(C*, i^*) > for any {^}^{w)}, {r^}^} and 

{'y}}. Therefore, {0* (w)}, {t]*A and {7*} must be an optimal solution. □ 



V. Node-Based Network Algorithms 

After obtaining the optimality conditions, we come to the question of how individual nodes 
can adjust their local optimization variables to achieve a globally optimal configuration. In this 
section, we design a set of algorithms that update the nodes' routing variables, power allocation 
variables, and power control variables in a distributed manner, so as to asymptotically converge 
to the optimum. 

Since the JOPR problem in (fT6l ) involves the minimization of a convex objective over convex 
regions, the class of gradient projection algorithms is appropriate for providing a distributed 
solution. An iteration of the gradient projection method involves making a small update in a 
direction (typically opposite of the direction of the gradient) which reduces the network cost. 
Whenever an update leads to a point outside the feasible set, the point is projected back into 
the feasible set [27]. The gradient projection approach was adopted by Gallager for distributed 
optimal routing in wireline networks [2]. The algorithm in [2], although guaranteed to converge, 
has a slow rate of convergence due in part to very small stepsizes. To improve the convergence 
rate of the gradient projection algorithms, it is generally necessary to scale the descent direction 
using, for instance, second derivatives of the objective function. In the latter case, the scaled 
gradient projection algorithm becomes a version of the projected Newton algorithm, which is 
known to enjoy super-linear convergence rates when the initial point is close to the optimum [27]. 
In the current network setting, however, the inherent large dimensionality and the need for 
distributed computation preclude exact calculation of the Hessian required for the Newton 
algorithm. Motivated by these considerations, Bertsekas et al. [3] developed distributed optimal 
routing schemes for wireline networks where diagonal approximations to the Hessian are used to 
scale the descent direction. Although the algorithm in [3] represents a significant step forward. 
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it suffers from two major problems. First, the algorithm in [3] is not guaranteed to converge if 
the initial point is too far from the optimum. Second, substantial communication overhead is 
still required to compute the scaling matrices in a distributed fashion [3]. 

In this section, we develop a set of scaled gradient projection algorithms which update 
the nodes' routing, power allocation, and power control variables in a distributed manner for 
a wireless network. Network protocols which allow for the information exchange necessary 
to implement these algorithms are specified. We develop a new technique for selecting the 
scaling matrices for the routing, power allocation, and power control algorithms based on 
upper bounds on the corresponding Hessian matrices. We show that the resulting algorithms 
are guaranteed to converge rapidly to the optimum point from any initial condition with finite 
cost. Moreover, we show that convergence can take place with limited control overhead and 
distributed implementation. In particular, the routing algorithm exhibits faster convergence than 
its counterpart in [2] and requires less communication overhead than its counterpart in [3]. 

A. Routing Algorithm (RT) 

We will develop a suite of algorithms that iteratively adjust a node's routing, power allocation, 
and power control variables, respectively. First, we present the routing algorithm. 

The routing algorithm allows each node to update its routing variables for all traversing 
sessions. We design an algorithm in the general scaled gradient projection form studied in [3], 
which contains the algorithm of Gallager [2] as a special case. The scaling matrices in our 
routing algorithm, however, are different from those in [3]. We develop a new technique of upper 
bounding the relevant Hessians which leads to larger stepsizes, and therefore faster convergence, 
than those proposed in [2]. Moreover, in contrast to [3], our technique guarantees convergence 
from any initial condition with finite cost, and requires less computation and communication 
overhead to implement. 

1) Routing Algorithms of Gallager, Bertsekas, and Gafni [2], [3]: In order to establish the 
setting, we first review the (wireline) routing algorithms of Gallager, Bertsekas, and Gafni [2], 
[3]. Consider node i ^ D{w). At the fcth iteration, the routing algorithm RT updates the current 
routing configuration (t>\{w) = {(t)\^{w))j^o{i) by 

(/,f+^H=i?r((/>,^H), (38) 

where the update is determined by the following scaled gradient projection: 

Here, S4>^{w) = {S(j)fj{w)j^o(i)- The matrix Mf{w), which scales the descent direction for good 
convergence properties, is symmetric and positive definite. We will discuss how to choose M^{w) 
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in a moment. The operator [-J^^fc^^^) denotes projection on the feasible set relative to the norm 
induced by matrix Mf{w). This is given by 

[^*H]m*(^) = argmin - 4>i{.w), Mf{w){4),{w) - ^^H)), 

where (■) denotes the standard Euclidean inner product, and the minimization is taken over 
simplex 

(«^) = I 4>^{w) : 4>^{w) > 0, <j),,{w) = 0, Vj G Bliw) and ^ = 1 

Here, represents the set of blocked nodes of i relative to session w. This device was 

invented in [2], [3] for preventing loops in the routing pattern of any session. It contains the 
neighbors of i to which i cannot route session-w traffic . We will discuss (w) in more details 
later. With straightforward manipulation, one can show [3] that the projection (f)\'^^{w) is a 
solution to 

minimize 6c}>\{wy ■ {cf,,{w) - ci>\{w)) + - cf,\{w))' ■ ■ {cf>,{w) - ct>\{w)) 

subject to </>j(w) G J^f{w). 

(40) 

In the following, we use (l40l) to represent the scaled projection algorithm and refer to it 
specifically as the general routing algorithm, or GRT. 

The routing algorithm requires the following two supplementary mechanisms which coordinate 
the necessary message exchange and the suppression of loopy routes in the network [2], [3]. 

Message Exchange Protocol: In order for node i to evaluate the terms S(f)ij{w) in (|22)) . it 
needs to collect local measures dDij/dEij as well as reports of marginal costs dD / drj{w) 
from its neighbors j to which it forwards session-w traffic. Moreover, node i is responsible 
for calculating its own marginal cost according to (|24|) . and then providing to its 

neighbors from which it receives traffic of w. In [2], the rules for propagating the marginal 
routing cost information are specified. 

Loop-Free Routing and Blocked Node Sets: The existence of loops in a routing pattern 
gives rise to redundant circulation of data flows, hence wasting network resources. The device 
of blocked node sets Bi{w) was invented in [2], [3] to suppress the formation of loops in 
each iteration of the distributed routing algorithm. Intuitively, the blocking mechanism works 
as follows. A node does not forward flow to a neighbor with higher marginal cost or to a 
neighbor that routes positive flow to some other node with higher marginal cost. Such a scheme 
guarantees that each session's traffic flows through nodes in decreasing order of marginal costs, 
thus precluding the existence of loops. For more details, please refer to [2], [3]. 
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Scaling Matrices and Stepsizes: Generally speaking, there is a tradeoff between the complex- 
ity of algorithm iterations and the speed of convergence to the optimal point. A simple structure 
for the scaling matrix can greatly reduce the complexity of each iteration. In particular, if 

Ml{w) = ■ diag{l, ■ ■ ■ , 1, 0, 1, ■ ■ ■ , 1}, (41) 

where the only zero entry on the diagonal is at the jth place such that j E argmin^ 
then (|40|) becomes equivalent to the routing algorithm by Gallager [2] . That is 

0^iH = 0fH + A<^,H, (42) 

where the increment A0-(w) = {A(t)ij{w))j(zo(i) is given by 

A0.,(w) = 0, Vj G (w), 

a,, ^ - min S^^iiw), Vj G 0{t)\B^{w), 

■' ieO{i)\B'y{w) 



, a^{w)aij'\ (43) 
I tf{w) J 

A0ij(w) = - ^ A0j,(w), for one j : a^- = 0. 

¥j 

We will refer to (l42l)-(|43l) as the basic routing algorithm or BRT. The BRT simplifies the quadratic 
optimization in (|40l) to a scalar form and reduces the scaling matrix selection to a choice of 
the stepsize af(ry). The simplicity of a BRT iteration, however, comes at the expense of the 
convergence rate. In particular, excessively small stepsizes can lead to slow convergence. This 
is the case for the routing algorithm of Gallager [2], for which the stepsizes are proportional to 
|Ar|-«). 

In order to improve the convergence rate, the scaling matrix M^{w) needs to approximate the 
Hessian more closely. This is the approach adopted in [3], where second-derivative algorithms 
are developed. The scaling matrix is obtained by dropping all off-diagonal terms of the Hessian 
matrix, and approximating the diagonal terms via a second-derivative information exchange 
process [3]. Here, each iteration entails a more complex quadratic program. The Hessian ap- 
proximation scheme in [3] is quite involved. Moreover, the algorithm works well only near the 
optimum. When starting from a point far from the optimum, convergence cannot be guaranteed. 
This is due to the fact that the scaling matrices generally are not upper bounds on the Hessians, 
and the Hessians being estimated are evaluated at the current routing configuration rather than 
at intermediate points between the current and next routing configurations. 
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2) A New Scaled Gradient Projection Routing Algorithm: In this section, we present a scaled 
gradient projection routing algorithm for wireless networks based on a new scaling matrix 
selection scheme. In this new scheme, the scaling matrix is chosen to be an upper bound on 
the Hessian matrix evaluated at any intermediate point between the current and next routing 
configuration. The new scheme has several advantages over the approach of [2] and [3]. First, our 
technique can generate stepsizes for the BRT algorithm of [2] which are larger than those in [2], 
leading to an improved convergence rate. Second, in contrast to the approximation scheme used 
in [3], our method requires less control overhead for distributed computation. More importantly, 
since our scheme finds an upper bound on the Hessian matrices evaluated at any intermediate 
configuration, it guarantees convergence of the GRT from any initial point. Finally, whereas the 
algorithms in [2] and [3] assume that all nodes in the network iterate at the same time, our 
algorithms allows nodes to update one at a time. This latter mode of operation may be more 
appropriate in wireless networks without a central controller, where individual nodes can update 
their routing variables only in an autonomous and asynchronous manner. 

To describe our new algorithm, let AM-iw) = 0{i)\B^{w) and let h^{w) denote the maximum 
number of hops on a path from i to D{w). Given that the initial network cost is upper bounded 
by < oo, node i finds the quantities 

AUD^) ^ max 
4 max 

A diagonal upper bound on the Hessian matrix with respect to the routing variables can be found 
as in the following crucial lemma. Its proof is contained in Appendix |Bl 

Lemma 2: If the initial network cost is less than or equal to D° < oo, then at every iteration k 
of the general routing algorithm of (gO]) and for all A G [0, 1], /fj;^^) = D{ct},{w))\^^k^^^^^^^_^^^k+i^^^ 
is upper bounded by the diagonal matrix 

= t.'=H'diag{(4(Z^°) + \AM^{w)\h';{w)A'{Do))^^^,^^^} 

in the sense that for all Vi e V^{w) = ^^Vi : Y^jeAAf^M ^'^}' '"'i' ^Oi^)''"' - K-Mi{w)-Vi. 
Proof: See Appendix |Bl 

Note that the evaluation of M^{w) requires a simple protocol in which at each iteration k, 
each node j provides its immediate upstream neighbors with hj(w), which is derived from those 
counts reported by j's next-hop neighbors. The computation can be carried out in a simple 
distributed Bellman-Ford form: 

h''(w) = max hf(w) + 1, 
^ zeo(i) 
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where h%^^^{w) 



0. 



We will show that if we choose 2t^(w)M^{w) to closely upper bound -f^^'^^j via Lemma [21 



the resulting routing algorithms will have fast and guaranteed convergence to the optimal con- 
figuration. For the BRT (|42l) -(|43l). this amounts to choosing the stepsize «f (w) as 



\AN^i{w)\ max {A\AD^) + \AU'l{w)mw)A\D^)] 



For the GRT, this amounts to choosing the scaling matrix M^{w) as 



MNw) 



2tfM 



diag + \AAf^{w)\h'^{w)A'{D')) 



(44) 



(45) 



As we will show later in Theorem [2l with a'l;{w) and Mf{w) specified above, each iteration 
of BRT or GRT strictly reduces the network cost unless conditions (|29l)-(l30l) are satisfied by 



B. Power Allocation Algorithm (PA) 

Let PA(rj^) denote the algorithm applied by node i to vary its transmission power allocation 
variables. At the kth iteration, PA updates the current local power allocation rj'i = {^ij)jeo{i) 
by r}'l'^^ = PA{r]'i) where r}^^'^ is the solution to 

minimize 6r)f ■ (ry^ - ryf) + ^(ry^ - Tyf)' ■ • (ry, - ryf) 

(46) 

subject to > 0, Yl Vij = 1- 

jeO{i) 

We refer to (l46l) as the general power allocation algorithm or GR\. Here, ^ryf = {5ri^j)j^o{i)^ 
and is the scaling matrix, which we will specify in a moment. 

1) Local Message Exchange: Note that marginal power allocation costs driij involve only 
locally obtainable measures (cf. (|26l)). Thus, the power allocation algorithm needs only a simple 
local message exchange before an iteration of PA. 

In particular, let each neighbor j of node i measure the value of SINRij and feed it back to 
i. Then i can readily compute all Sr]ij's according to 

dDi, Ci^SINRij ^ 

which follows from a modification of (f26b. 
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2) Scaling Matrix: As in the BRT of Gallager, we can adopt a simple structure for Q'l to 
facilitate iterations at each node. Specifically, let Q'l = Q/l3f where /3f is a positive scalar 
and Q = P^*^diag{l, ••• ,1,0,1,-- - ,1} with the only zero entry at the jth place such that 
j e argmin; 6r]'^i. Thus, the GPA (|46l ) is reduced to the following basic power allocation algorithm 
(BPA): 

ri^^' = ri'y + Arj„ (47) 

where the increment Ar}^ = {/S.riij)j^o{i) is computed as 

^ij - ^Vii - min 67]fi, 
^ leoii) 

Ariij = -min{r/f^.,/5f%/Pi}, Vj : kj > 0, (48) 
Ar]ij = - ^ Ar]ii, for one j : % = 0. 

l:bu>0 

We now specify the appropriate stepsize /9f for BPA and appropriate scaling matrix for 
the GPA. Assume that the sum of the local link costs at node i before the A;th iteration is 
J2jeO{i) ^ij ~ ^i- Since the powers used by the other nodes do not change over the iteration, 
Cij depends only on r]ij as 

It can be shown that there exists a lower bound 77 . on the updated value of 7]ij such that 
C_^j = Cij{ri..) and Dij{C_^j, Fjj) = D^. Accordingly, the possible range of xij is 

) + 

Define an auxiliary term as 



min A -ij ^ ^ '^ij'^i A ^max 



B,^{D'y) max {C'{xfx\l + x)^}+ 



{C"{x)x'{l + xf} 

m 



where Bij{D'l) = raax^^. (^Q^. pk^^^k -g^. We have the following important lemma, whose proof 
is deferred to Appendix O 



Lemma 3: Denote the local cost at node i at the beginning of iteration k of the power 
allocation algorithm by D'^ = J2jeo{i) ^ij^ ^^^^ ^ l^^ Hessian matrix H^'-^ = 

^'^D{'ni)\xrj''+(i-x)n''+^ upper bounded by the diagonal matrix 

Qi = cliag{(Ai)ieO(i)} 

with Pij given by (|49l), in the sense that for all Vi G Vr,^ = jj/j : Y.jeo{i) Vij ^ K'H^'^-v 
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Using Lemma [H we can choose the stepsize /?f in the BPA algorithm to be 

(50) 

and the scaling matrix for the GPA algorithm to be 

Q' = || = ^diag{(A,),,ow}. (51) 

It can be shown using the arguments of Theorem [2] below that the BPA and GPA algorithms 
with the and specified above strictly reduce the network cost at every iteration unless 
dSTI) is satisfied by 6r]^. 



f3^ = m 



k\2 



\0(i)\ max 



C. Power Control Algorithm (PC) 

At the kth iteration of the power control algorithm PC, the power control variables j'' = 
are updated by 

-f'+' = PC{-f'), (52) 

where 7*^+^ is the solution to 

minimize 6 j''' ■ (j ~ + ^{-f - j'')' ■ V''- {j - j'') ^^^^ 
subject to 7 < 1. 

Here matrix V'^ is symmetric, positive definite on R'-^L Note that in general (|53] ) represents a 
coordinated network-wide algorithm. It can be decomposed into distributed computations if and 
only if V'' is diagonal. In this case, denote V'^ = diag{(f j)^^^^}, (l53l) is then transformed to \J\f\ 
parallel local sub-programs, each having the form 

7^^ = PC(7f ) = min 1 1, 7f - ^ 1 . (54) 



1 ) Power Control Message Exchange: Unlike the power allocation algorithm, S'ji depends on 
external information from nodes m ^ i (cf. (|28])). Thus, its calculation must be preceded by a 
message exchange phase. Before introducing the message exchange protocol, we re-order the 
summations on the RHS of (l28l) as 



2^ ~~QC In 

mdl (n) 



in ' Vin- 

(55) 

neO{i) 



With reference to the expression above, we propose the following protocol for computing the 
values of 6% for all i E M. 

Power Control Message Exchange Protocol: Let each node n assemble the measures 

dDmn Cjj^j^SINRmn ^^mn C I N Pj^^ 



^^rrt.n ^-^^mn ^^mn ^mn-^ mn 
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Fig. 2. Power Control Message Generation 

on all its incoming links {m,n), and sum them up to fonn the 

Power Control Message: MSG{n) = ^ _ olj n^^^ii^n^n _ ^5^^ 

mdl in) 

It then broadcasts MSG{n) to the whole network via a flooding protocol. This control message 
generating process is illustrated by Figure [2l Upon obtaining MSG{n), node i processes it 
according to the following rule. If n is a next-hop neighbor of i, node i multiplies MSG{n) 
with path gain Gm and adds the product to the value of local measure brjin ■ rfin, otherwise, node 
i multiplies MSG{n) with Gj„. Finally, node i adds up all the processed messages, and this sum 
multiplied by Pi equals 5'yi. Note that this protocol requires only one message from each node 
in the network. Moreover in practice, a node i can effectively ignore the messages generated by 
distant nodes. To see this, note that messages from distant nodes contribute very little to due 
to the negligible multiplicative factor G^ on MSG{n) when i and n are far apart (cf. (l55l)). 
This observation is borne out by the results of numerical simulations presented in Section IVIIIi 
where it is shown that the power control algorithm converges reasonably well even when every 
node exchanges power control messages only with its close neighbors. 

2) Alternative Implementation: Note that it is not mandatory to have all the nodes i E M 
perform an update at each instance of the PC{-) algorithm. One may consider the case where only 
a subset of nodes 7V^ iterate PC(-), i.e. 7^+^ = PC(7f ) for aU i e 7V\ and 7^+^ = 7^ for aU 
i ^ M'^. As long as no node is left out of the updating set M'' indefinitely when the conditions 
(I32l)-(l33l) are not satisfied by 7^, the convergence result proved in the following subsection 
applies. However, in order to minimize control messaging overhead, it may be preferable to 
have each round of global power control message (MSG{n)) exchange induce one iteration of 
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power control algorithm at every node (as opposed to iterations at only a subset of nodes). Our 
subsequent analysis of algorithm convergence and scaling matrix selection will be based on this 
latter mode of implementation. 

3) Scaling Matrix: As for previous algorithms, we select the scaling matrix V'' to be a 
diagonal upper bound on the Hessian matrix. Specifically, given that the initial network cost is 
less than or equal to D'^, the following terms can be evaluated: 

B[D ) = max max 



dD 

L/ mil. 



B_{D ) = min min 



Moreover, due to the individual power constraints (fTTI) . there exists a finite upper bound x on the 
achievable SINK on all links. Define n = maxo<2,.<s C'{x)'^ ■ x^, and ip = mmQ<^<x C"{x) ■ x^. 

Lemma 4: Assume the initial network cost is less than or equal to D'^ < oo. At each iteration 
of the power control algorithm (l53l) . H^''^ = V^-D(7)|A-yfe+(i-A)7'=+i is upper bounded by the 
diagonal matrix 

for all A G [0, 1], in the sense that for all v e RI-^I, 

v' ■ H^'^ ■v<v' -V -v. 

The proof of the lemma is contained in Appendix |Dl Using Lemma |4] and the arguments of 
Theorem [21 below, we can show that with the scaling matrices chosen as 

V=^mS\ [B{D')K + BiD')^]diag{{S,),^M}, (57) 

the power control algorithm strictly reduces the network cost at every iteration unless (|32l)-(|33]) 
are satisfied by ^7*^. 

Notice that V is independent of the iteration index k, and can be determined at the first 
iteration. Also notice that applying the scaling matrix V in (l57l) is equivalent to letting each 
node set 

in the node-based iteration (|54l) . 
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D. Convergence of Algorithms 

We now prove the central convergence result for the class of scaled gradient projection 
algorithms discussed above. 

Theorem 2: Assume an initial loop-free routing configuration {(f)l{w)) and initial valid trans- 
mission power configuration (77^) and 7" such that the initial network cost is upper bounded 
by D° < 00. Then the sequences generated by the BRT, BPA algorithms with stepsizes given 
by (|44)) and (l50l) or by the GRT, GPA and PC algorithms with scaling matrices given by (|45l) . 
(ISTl) and dST]) converge, i.e., {(jJl{w)] {ryf} {rj*}, and 7*^ ^ 7* as A; 00. 

Furthermore, the limits {(p*(w)}, {rj*} and 7* satisfy the optimality conditions (|29l)- (l33l) . 

Proof: We first show that with the stepsizes and scaling matrices specified earlier, every 
iteration of each algorithm strictly reduces the network cost unless the corresponding equilibrium 
conditions in (|29l)-(l33]) of the adjusted variables are satisfied. We present a detailed proof for 
the stepsizes and scaling matrices in the basic and general routing algorithms RT{ct)\{w)). The 
analysis for the other algorithms is almost verbatim. For notational convenience, the session 
index w is suppressed. 

Consider the A;th iteration of RT{-). If = 0, the algorithm has no effect on the network 
cost whatever the update is. We thus focus on the case of > 0. Since is positive definite, 
the objective function of (|40|) is convex in </)j. Moreover, since the feasible set J-'j' is convex. 



the solution (p^^^ satisfies [27] 

[50,^= + Mf (0^1 - 0,^)]' ■ (0^^ - 0,) < 0, Vc/>, e Tl (58) 
Setting </)• = 0^, we obtain 

50f ■ (0^^ - 4^) < -(</>^^ - 0f )' ■ Mf ■ ((^r^ - 4^^). (59) 
By Taylor's Expansion, the network cost difference after the current iteration is 

^(0^1) - Di4^) = (tf ■ 5cj>^y ■ (0^1 - cj>>^) + ^(0^1 - cf>^y ■ /jjf • (0^1 - 41) 

where H'^^ is the Hessian matrix of D with respect to components of <j)^, evaluated at A</)f + 
(1 - A)0f+^ for some A G [0, 1]. By Lemma [2l both the Mf given by (EB with af given 
by dSl) and the Mf given by ^ upper bound iJ^'^/(2tf) in the sense that -tf Mf + i7^'^/2 is 
negative definite. Thus, with one iteration D{(f)i^^) ~ D{(pi) ^ 0, where the inequality is strict 
unless 4>i^^ = 4>i' which happens only when conditions (|29l)-(l30l) hold at 4>i- In conclusion, an 
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iteration of BRT with in (l44l) or an iteration of GRT with M^f in (|45] ) strictly reduces the 
network cost until the equilibrium conditions for (p^ are satisfied. 

Similarly, by Lemmas [3] and H we can show that network cost is strictly reduced by the 
iterations of the BPA, GPA and PC algorithms with stepsizes or scaling matrices given by (|50l) . 
(ISTI) and (l57l) . unless (|3T1) -(l33l) are satisfied by the current ryf and 7^. 

To summarize, with the specific choices of stepsizes and scaling matrices derived earlier, any 
iteration of any of the algorithms BRT, GRT, BPA, GPA and PC strictly reduces the total network 
cost with all other variables fixed, unless the equilibrium conditions for the adjusted optimization 
variables (dlU-dlOl) for </)j(w), (HB for rj^, for 7^) are satisfied. Recall that the feasible 

sets of and 7 are given by dS]) and (fT5l) . The sequences {(f>i{'w)}T=o ^^'^ {^flfc^o 

clearly take values in compact sets. Although 7^^ is explicitly only upper bounded by 1, the fact 
that the network cost is always upper bounded by implies an implicit lower bound on 7III 
Thus, for any finite initial network cost D^, {7^}^q also takes values in a compact set. It follows 
that {0(^(w)}^Q, {r/fj^O' {j'^}k'=o rnust each have a convergent subsequence. Since the 
sequence of network costs generated by iterations of all the algorithms is non-increasing and 
bounded below, it must have a limit D*. Therefore, the network cost at the limit points 4>*{w), 
rj* and 7* of the convergent subsequences must coincide with D*. Because D* cannot be further 
(strictly) reduced by the algorithm iterations, ry* and 7* must satisfy conditions (|29l)- (|33l) . 

□ 



From the proof we can see that the global convergence does not require any particular order 
in running the three algorithms at different nodes. For convergence to the joint optimum, every 
node i only needs to iterate its own algorithms until its routing, power allocation, and power 
control variables satisfy (|29l)-(l33l) 

It is important to note that the structure of the routing, power allocation, and power control 
algorithms make them particularly desirable for distributed implementation without knowledge 
of global network topology or traffic patterns. The algorithms are fundamentally driven by 
the relevant marginal cost messages. These marginal cost messages contain all the information 
regarding the whole network which is relevant to each iteration of any algorithm at any given 
node. Thus, it is not necessary for the network to perform localization or traffic matrix estimation 
in order carry out optimal routing. The fact that the algorithms are marginal-cost driven also 
means that they can easily adapt to relatively slow changes in the network topology or traffic 

"For each component 7^ of 7, a lower bound can be derived as 7 . — maxjgofi) 7. , where Dij (C{{Gij (Pi)-^^ ) /Nj), 0) = 

D°. That is, 7, , is the power control level that yields a cost of on link assuming the total power of i is allocated 

— ''J 

exclusively to {i,j) and all other links are non-interfering. 

'^In practice, nodes may keep updating their optimization variables with the corresponding algorithms until further reduction 
in network cost by any one of the algorithms is negligible. 
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patterns. For if channel gains and/or traffic input rates change, then the relevant marginal costs 
change accordingly, and the node iterations naturally adapt to the new network conditions by 
responding to the new marginal costs. The adaptability of the algorithms to changing network 
conditions is confirmed in numerical experiments presented in Section |VIII-B[ 

VI. Refinements and Generalizations 

In this section, we introduce a number of refinements and generalizations to improve the 
applicability and utility of our analytical framework and proposed algorithms. Specifically, we 
consider three main issues. First, we present a refinement of the power allocation algorithm 
for CDMA networks with single-user decoding by relaxing the high-SINR assumption in 
This assumption has thus far limited the range of feasible controls for the power allocation 
and power control algorithms. To address this problem, we introduce a heuristic two-stage 
network optimization scheme which significantly enlarges the range of control possibilities. 
Next, we generalize the SINR-dependent network model to analyze wireless networks operating 
with general physical-layer coding schemes. Instead of assuming concave capacity functions 
dependent on the links' SINR, we assume link capacities are given by a general convex achievable 
rate region. We then characterize the optimality conditions for the JOCR problem given a general 
convex rate region. Finally, we relax the requirement that the link cost functions are jointly 
convex in the link capacities and link flow rates. This joint convexity assumption was needed to 
prove that the necessary conditions for global optimality are also sufficient. We show that if cost 
functions satisfy the less stringent requirement of strict quasiconvexity, then solutions satisfying 
the necessary conditions for optimality still have the desirable property of being Pareto optimal 
when the underlying capacity region is strictly convex. 

A. Refined Power Allocation and Two-Stage Network Optimization 

Our formulation of the joint power control and routing problem in (fT6l)-(|20l) rests on the crucial 
condition (fT2l) on the capacity function. Such an assumption implies that limj.^o+ C"{x) = — oo 
since by monotonicity lim^_»o+ C'{x) > 0. However, this yields the rather disturbing result 
that \irax^Q+ C (x) = oo and lim^^o+ = — oo. The approximate information-theoretic 
capacity ^ and the M-QAM capacity (flOl) with error probability constraint satisfy (fT2l) . but are 
both based on the high-SINR approximation. Indeed, since CDMA networks typically do have 
high per symbol SINR due to the large processing gain K, C = \og{K ■ SINR) have been 
extensively used as a reasonable approximate capacity function for CDMA networks in previous 
literature [18], [19]. Outside of the high-SINR regime, however, C = \og{K ■ SINR) becomes 
too inaccurate to be applicable because, for instance, it gives C < when SINR < 1/K and 
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C = — oo when SINK = 0. Thus, adopting C = log{K ■ SINK) as the capacity function 
significantly restricts the optimization of transmission powers and traffic flowsO 

Ideally, instead of \og{K-SINR), we would use the precise capacity function C = \og{l+K ■ 
SINK). Note that the latter function does not satisfy (fT2)) . and does not lead to a convex JOPR 
problem in the original framework of Section Hill However, we show that if the total powers 
of individual nodes {Pi} (or equivalently {7i}) are held fixed, the precise capacity function 
does give rise to a convex optimization problem in typical CDMA networks. In other words, 
the JOPR problem involving only routing and power allocation is convex in the optimization 
variables {(f)ij{w)} and {rjij} when the link capacities are given by C = \og{l + K ■ SINK). We 
call this revised problem the Jointly Optimal Power Allocation and Routing (JOPAR) problem. 

1 ) Concavity of the Precise Capacity Function: Since the change of link capacity functions 
does not alter the convexity of the objective function with respect to the flow variables, we need 
only verify that the objective function is jointly convex in the power allocation variables {%}. 
This is equivalent to showing that each link capacity function 



Cij = log 



1 + 



KGijPiTjij 



\ 



\ 



^ij Pi ( Vij ) Cr^Yij P„ 



iV, 



(61) 



is concave in rjij. 

Lemma 5: Link capacity Cij given by (|6T1) is concave in r]ij if the following interference- 
limited condition holds: 

KG,,P,,<{K-2)INij. (62) 

Note that the condition (l62l) is almost always satisfied in CDMA systems, where interference 
level INij is usually higher than that of the received signal power GijPij by several orders of 
magnitude [26]. 

Proof of Lemma \5}; Differentiating the RHS of (|6T1) twice with respect to rjij 
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Using (|62|) . we have 



<Pfl- 



{K-l)G,, 
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- 2 

+ 


Gij 


1 
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Note that if the network running the RT, PA, and PC algorithms described above starts with a control configuration with finite 
cost, then the capacity of each link (i, j) (under the high-SINR assumption) must be positive, implying that SINRij > 1/K. 
Since the algorithms reduce the total network cost with each iteration, the condition SINRij > 1/K continues to hold with 
each iteration. Moreover, since the high-SINR assumption wnderestimates the actual link capacity, the power control and routing 
configurations resulting from RT, PA, and PC are always feasible. 
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which implies that Cij is concave in rjij. □ 

2) Power Allocation and Routing for JOPAR Problem: The JOPAR problem holds {7i} fixed, 
so its solution is obtained only through varying {(pij{w)} (routing) and {r]ij} (power allocation). 
In particular, the routing scheme is unchanged from that for the original problem (fT6l) . On the 
other hand, the marginal power allocation cost needs to be revised according to (|6TI) as 

dD,^ [ {K- 1)G,, , G,, 



'^'''-W^[ KG,I,,,:^lN, ^li-)''^°'^- '''' 
With {S(j)ij{w)} and {5r]ij} given by (l22l) and (l63l) . the optimality conditions for the JOPAR 

problem are stated as in Theorem [T] with (|32l ) and (|33] ) removed. 

We now specify the power allocation algorithm (PA) for the JOPAR problem. It retains the 

same scaled gradient projection form as in (l46l) but with the scaling matrix given differently 

as follows. 

Lemma 6: If the current local cost is V ^^o, ^ -D'l = -Df, then at the current iteration of the 
PA algorithm in (|46|) (with revised (5%) given by (l63l) ) and for all A G [0,1], the Hessian 
matrix H!^'^ = '^'^ D{'ni)\r^.=xrf+{i-X)'q''+^ upper bounded by the diagonal matrix 



=Ar,f + (l-A)77f 

Q\ = diag{([5j(Z^f)ir^ -5f^.(A') [K-lf] (iVi?.,)^)^.,^(J 



where 



Sj.pf)^ max (64) 
miDl)^^ „ (65) 



C,j:D,,iC,j,F^))<D^ dC, 



and 



The proof of the lemma is in Appendix |El Accordingly, the stepsize for the BPA algorithm (l47l) 
can be chosen as 



/3f = 2Pf 



|0(.)| max [Bl^mK' - B^^,m (K - if] {NR^.f 



(67) 



One can also apply the GPA algorithm (|46l) for the JOPAR problem. In this case, the scaling 
matrix is given by 

Such a choice of /3f and guarantees that any iteration of the BPA and GPA algorithms 
strictly reduces the network cost unless condition (|3T1) is satisfied. As a result, the refined power 
allocation algorithm and the routing algorithm can converge to an optimal solution of the JOPAR 
problem from any initial configuration of {4>ij{w)} and {rjij}. 
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3) Heuristic Two-Stage Network Optimization: The refined power allocation technique based 
on the precise capacity formula allows us to adjust link powers over their full range from zero 
to the total power of their respective transmitters o This fine-tuning capability, however, comes 
at the expense of fixing the total power of nodes. Should the node powers (Pj) be variable, the 
capacity function log(l + K ■ SINR(P)) would no longer be concave in link power variables. 
Although the power control algorithm in Section |V] is built on the high-SINR approximation, 
in practice it can be applied in conjunction with the routing algorithm and the refined power 
allocation algorithm developed above. 

To carry out the overall task of routing and power adjustment, we let the nodes iterate between 
a routing/power allocation stage and a power control stage. In the routing/power allocation 
stage, nodes adjust their routing variables (pijiw) and power allocation variables 7]ij as in the 
JOPAR problem discussed above according to the refined PA algorithm while holding the total 
transmission power Pi fixed, evaluating link capacities by the precise log(l + K ■ SINR{P)) 
formula. As pointed above, this routing/power allocation stage can asymptotically achieve the 
optimal set of (rjij) and for the given total powers (Pi). 

To further (strictly) reduce the total cost, one can switch to the power control stage, where total 
power Pi's are adjusted by the power control algorithm (|54l) while holding the routing variables 
(l)ij{w) and power allocation variables rjij fixed. By using the approximate \og{K ■ SINR{P)) 
formula in the power control stage, the total cost is convex in the power control variables (74). 
Power control algorithms thus can converge to the optimal total powers under the fixed routing 
{(f)ij{w)) and power allocation (rjij). 

Heuristically, one can then iterate between the routing/power allocation and power control 
stages to arrive at a network configuration that is approximately optimal. 



B. General Capacity Regions 

Up to this point, we have assumed that link capacities are functionally determined by the 
links' SINR. Under individual power constraints (fTT)) and assumption (fT2)) . the achievable link 
capacities were shown to constitute a convex set. In order to place our analysis and algorithms in 
a broader setting where more general coding/modulation schemes are applied, we now consider 
the general JOCR problem (|5]) where the achievable rate region C is any convex set in the positive 
orthant M!^ • The convexity assumption is reasonable since any convex combination of a pair of 
feasible link capacity vectors can at least be achieved by time-sharing or frequency-sharing. 

The following theorem characterizes the optimality conditions for the JOCR problem with a 
general convex capacity region. 

'''More precisely, in order to keep the link cost finite, the refined power allocation algorithm only allows one to reduce link 
powers arbitrarily close to zero. 
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Theorem 3: Assume that the cost functions Dij{Cij, Fij) satisfy ([3]) and assume that C is 
convex. Then, for a feasible set of routing and capacity allocations (0jj(w))uiGW,(jj)G£: ^iid 
(Cjj)(j to be a solution of JOCR ©, the following conditions are necessary. For all i E M 
and w eW such that ti{w) > 0, there exists a constant Xi{w) for which 

S(f)ij{w) = \i{w), if (pijiw) > 0, 

(68) 

> Xi{w), if (pijiw) = 0. 

For all feasible {ACij)(^ij)e£ at iCij)(ij)e£, 

dD 

J2 -Q^iCik,F,,)-Aa,>0, (69) 

where an incremental direction (ACjj)(jj)gf: at (C'y)(jj)g^ is said to be feasible if there exists 
5 > such that {dj + 5 ■ ACij)(^ij)e£ ^ C for any 5 G (0, 5). 

If Dij{Cij, Fij) is jointly convex in (Cij,Fij), the above conditions are also sufficient when 
(l68l) holds for all z G A/" and w E W whether U^w) > or not. Furthermore, the optimal 
(Cj* is unique if C is strictly convex. If, in addition, Dij{Cij, Fij) is strictly convex in Fij, 

then the optimal link flows iF*j)(^ij)^£ are unique as well. 

Proof: The necessity and sufficiency statements can be proved by following the same argument 
used for proving Theorem [TJ Thus, we do not repeat it here. We show only the uniqueness of 
the optimal (Cij) and (Fij) under the respective assumptions. 

Suppose on the contrary, there are two distinct optimal solutions { (C° ) , (i^j) } and { (Clj), (Flj)} 
such that (C° ) ^ (Clj) and their common minimal cost is D*. Consider the total cost resulting 
from {(C^^), (4)}, where C^^ = AC" + (1 - X)Cl^, F^- = XFf^ + (1 - A)^ for aU E £ 
and for some A G (0, 1). 

By the joint convexity of Dij{-, ■), we have for all (i, j) G 8, 

D.,{C^^, i^) < AA,(CS, i^) + (1 - A) A,(CJ, 4). 
If C is strictly convex and {C° } 7^ {0}^}, there must exist {C^j} E C such that 

with at least one inequality being strict. Without loss of generality assume C^,^ > C^.^. Using 
the fact that |gi < for aU we have D,j{C^-, F^^-) < Dij{C^j, F^^^) and in particular 

DmniC^n^Fmn) < ^mn ■ Therefore, summing over aU links, 

J2 D,,{C^,Fi)< J2 A,(C^,i^)< AA,(C°,i^) + (l-A)A,(Ci,i^i)=D*. 

(i,j)G£- {i,j)e£ {ij)ee 

Since {(C^j), (Fij)} is feasible, the above inequality contradicts the optimality of D*. When 
Dij{Cij, ■) is strictly convex in F^j, a similar contradiction arises if the optimal (-Fjj)'s are not 
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unique. Thus the proof is complete. □ 



C. Quasiconvex Cost Functions and Pareto Optimality 

After considering general convex capacity regions, we turn our attention to the network cost 
measures. The sufficiency of conditions (|68l) -(l69l) for global optimality depends on link cost 
functions Dij{Cij, Fij) being jointly convex in {Cij, Fij). Without the joint convexity assumption, 
inequality (|35l) is no longer valid, and the sufficiency parts of Theorem [T] and Theorem [3] do not 
hold. On the other hand, our initial assumptions in ([3]) regarding the cost functions do not imply 
Dij{Cij, Fij) is jointly convex. In particular, the often-used cost function Q_^^p, is not jointly 
convex. We show in the following, however, that if the cost functions satisfy the less stringent 
requirement of strict quasiconvexity, then solutions satisfying (l68l)- (|69l) are in fact Pareto optimal. 

In the subsequent analysis, we assume that for all (i, j) E £, Dij{Cij, F^) is twice continuously 
differentiable on X = {{Cij, Fij) : < Fij < Cij}, and satisfies Q. Furthermore, we assume 
that Dij{Cij, Fij) is strictly quasiconvex, i.e. if 

A,(Cj,4)<A,(Cj,i^), (70) 

then 

A,(AC,?,. + (1 - A)CJ, A4 + (1 - A)i^5) < VA e (0, 1), (71) 

with strict inequality in (fTOl) implying strict inequality in (TtTI) . It is easily verified that the cost 
functions Fij /(Cij — Fij) and I /{Cij — Fjj) are both strictly quasiconvex. 

We consider the general JOCR problem ([5]) where C G is strictly convex. Due to 
assumption ([3]), for a fixed capacity allocation (Cij)(^ij)^£, © is a convex optimization problem 
with respect to {Fij{w)){i^j)^s. Hence, any feasible flow distribution {F*j){^i^j)(ze satisfying (|68] ) 
also satisfies 

^ A, (a„ F:j) = mm (C'.,' F,,). (72) 



On the other hand, given any feasible routing configuration, if condition (1691) holds at capacity 
allocation (C'j* )(i,j)e£, then it follows that 

A, (C*, F,j) = min Yl F,,). (73) 

Under the capacity model in Section IIII-B[ the algorithms proposed in Section |V] have been 
shown to drive any initial routing and capacity configuration to a limiting { (C*, )(jj)g£-, (i^* )(jj)g^} 
such that the condition dMl) is satisfied at (F-*) given (C*, ), and {C*j) satisfies dlH) given (F-*). 
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Under the more general convex-capacity-region model, suppose we have algorithms that also can 
drive the flow and capacity configuration to a limit {(C'j* ), iF*j)^ such that the conditions (|68l) - 
(|69l ) hold simultaneously. We are then interested in the question: to what extent can optimality 
be inferred from such a limit point? Although global optimality cannot be ascertained, we have 
the following Pareto optimal property. 

Theorem 4: Assume that the capacity region C is strictly convex and the link cost function 
is strictly quasiconvex. If a pair of feasible capacity and flow rate allocations {(C*, ), (Fj*)} 
satisfies conditions (|68l) and (|69] ) simultaneously, then the vector of link costs D{C*,F*) = 
(^Dij {Cij, F*j^^ ^. ^^^^ is Pareto optimal, i.e. there does not exist another pair of feasible alloca- 
tions {(Cj), (i^f )} such that 

with at least one inequality being strict. 

Assuming the cost function Dij = Fij/{Cij — Fij), Theorem |4] can be taken to mean that at 
the (Pareto) optimal point, the average number of packets cannot be strictly reduced on one link 
without it being increased on another. 

Proof of Theorem^ Suppose on the contrary D {C*,F*') Pareto dominates D{C*,F*). 
Without loss of generality, assume 

Because both C* and C* belong to C, and C is strictly convex, = XC* + {1 - X)C* 
is achievable for all A G [0,1]. Moreover, it can be deduced that ^ C*, since other- 
wise we must have F* ^ F*, and Pareto domination would imply j)e£ -^■i-j {pij-> -^tf) ^ 
j)es -^ij i^ij^-^ij)' hence contradicting identity (1721 ). Therefore, we conclude that is in 
the interior of C for any A G (0, 1). Using the same reasoning, we can assert that i^* ^ F*, 
and that F^ = \F* + (1 - A)F* is feasible for any A G [0, 1] simply by the linearity of the 
flow conservation constraint. 

As a consequence of Dij being strictly quasiconvex, D [C^, F^) Pareto dominates D {C* , F*) 
as weU for any A G (0,1), since Dmn {C^n, F^^) < Dmn{C^n,F;^J and A, < 
Aj {Cij,F*j^, for 7^ (m,n). Summing up all the terms on LHS and RHS, we have 

By optimality condition (|69l) and the fact that is in the interior of C for any A G (0, 1), 
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we have 



E^^iifn* F*) (r* — r*\ 

{i,j)&£ 

— \^ f^^: p*\ 

- Y3T ~q7j~ y'-'ij^-^ij) ' {'-'ij ^ '-'ijJ (75) 

where (C'j^)(ij)G£: is some capacity vector that strictly dominates (C'j^)(ij)G£:- 

Since Dij is twice continuously differentiable, there exists e > such that for all A G [1— £, 1), 

which, combined with the convexity of D^j (^■,F^), implies 

(ij)e^: {i,j)€£ {i,j)££ 

where the second inequality comes from (|74]). But this conclusion clearly contradicts (1721) . Thus, 
the claim is proved. □ 



VII. Congestion Control 

Thus far, we have focused on developing optimal power control and routing algorithms for 
given fixed user traffic demands. There are many situations, however, where the resulting network 
delay cost is excessive for given user demands even with optimal power control and routing. 
In these cases, congestion control must be used to limit traffic input into the network. In this 
section, we extend our analytical framework to consider congestion control for sessions with 
elastic traffic demands. We show that congestion control can be seamlessly incorporated into 
our framework, in the sense that the problem of jointly optimal power control, routing, and 
congestion control can always be converted into a problem involving only power control and 
routing. 

A. User Utility, Network Cost, and Congestion Pricing 

For a given session w, let the utility level associated with an admitted rate of be Uw^r^u). 
We consider maximizing the aggregate session utility minus the total network cost [4], i.e. 

maximize ^ f/^(r„) - ^ Dijidj, Fij). (76) 
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We make the reasonable assumption that each session w has a maximum desired service rate 
fyj. The session utility Uyj{-) is defined over the interval [0, fj\, where it is assumed to be twice 
continuously differentiable, strictly increasing, and concave. Taking the approach of [21], we 
define the overflow rate F^jb — — > for a given admitted rate < f^„. Thus, at each 
source node i = 0{w), we have 

XI + = r^. {11) 

Let Bw{Fwb) = Uw{fw) — Uw{rw) denote the utility loss for session w resulting from having a 
rate of rejected from the network. Equivalently, if we imagine that the blocked flow is 
routed on a virtual overflow link directly from the source to the destination [21], then By^{Fy,b) can 
simply be interpreted as the cost incurred on that virtual link when its flow rate is F^b- Moreover, 
as defined, By,{F^b) is strictly increasing, twice continuously differentiable, and convex in F^jb 
on [0,f^„]. Thus, the dependence of Byj{Fyjb) on F^b is the same as the dependence of the cost 
functions Dij(Cij, Fij) of real links on the flow Fij. Unlike Dij(Cij, Fij), however, has 
no explicit dependence on a capacity parameter lf| A virtual network including an overflow link 
is illustrated in Figure [3l where the overflow link wb is marked by a dashed arrow. 

Accordingly, the objective in (|76l ) can now be written as 

Since Xl«;ew ^ constant, (|76l) is equivalent to 

minimize ^ Dijidj, Fij) + ^ B^{F^b)- (79) 

(i,j)&£ uieW 

'^If we assume that Uw{Q) — — oo, so that there is an infinite penalty for admitting zero session w traffic, then B^{f^) = oo, 
and could be taken as the (fixed) "capacity" of the overflow link. 
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Note that (1791 ) has the same form as ([5]), except for the lack of dependence of Byj^Fyji,) on a 
capacity parameter. Thus, the problem of jointly optimal power control, routing, and congestion 
control in a wireless network is equivalent to a problem involving only power control and routing 
in a virtual wireless network with the addition of the virtual overflow links. 

B. Optimal Distributed Power Control, Routing, and Congestion Control 

We now turn to developing distributed network algorithms to solve the jointly optimal power 
control, routing, and congestion control problem in (l76l) . We show that the network algorithms 
developed in Section |V] can readily be adapted to deal with the new challenge of congestion 
control. Thus, seemingly disparate network functionalities at the physical, medium access, net- 
work, and transport layers of the traditional OSI hierarchy are naturally combined into a common 
framework. 

To specify the distributed algorithms, we continue to use the routing, power allocation, and 
power control variables, except for a modification of the definition of the routing variables (pi{w) 
at i = 0{w), w eW. Define 



jeO(i) 

We now state the Jointly Optimal Power Control, Routing, and Congestion Control (JOPRC) 
problem: 




(80) 



The new routing variables are subject to the simplex constraint 




minimize 




subject to 



(Pij{w) > 0, (pyjb > 0, 
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(81) 



Vij > 0, 
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where link flow rates and capacities are determined by the optimization variables as 



wew 



ti{w) ■ (pijiw) 



Fwh = to{w){w) ■ (pwh, 



ti{w) 



Cij — C 



' W1 



if i = Oiw) 



/ , tj{w) ■ (f)ji{w), if i^O{w) 

i6X(i) 



(82) 



^ij ( Pi ) '^^ Vij 



The optimality conditions for (fSTI) are the same as in Theorem [T} except that the optimal 
routing condition for all source nodes are modified. For all w E W and i = 0{w), these 
conditions are 



if > 



6(l)ij{w) = Xi{w), 
6(j)ij{w) > Xi{w), if 4>ij{w) 







if (pujb > 
if = 



(83) 



S4>wb > Xi{w), 

for some constant \i{w), where the marginal cost dcpwb of the overflow link is defined as 

6(j)^t = BiiF^b), yw G W. (84) 

The proof of the above result is almost a repetition of the argument for Theorem [H and is 
skipped here. This optimality condition can be interpreted as follows: the flow of a session is 
routed only onto minimum-marginal-cost path(s) and the marginal cost of rejecting traffic is 
equal to the marginal cost of the path(s) with positive flow. 

The distributed algorithms for achieving the optimum are the same as in Section |Vl except for 
changes at the source nodes. To mark the difference, we recast the modified routing algorithm 
as a joint congestion control/routing (CR) algorithm at the source nodes. At every iteration, it 
has the same scaled gradient projection form: 

Notice that the definitions for (j)i{w) and 54>i{w) now become (f)i{w) = (0ij(w))jeci(j)) 
and 54>i{w) = {^tpwh-, i^4'iji'^))jeo(i))- Accordingly, the scaling matrix M^{w) is expanded by 
one in dimension. 

Observe that with the introduction of the virtual overflow link, we naturally find an initial 
loop-free routing configuration for the CR algorithm: = 1 for all w G W. That is, the traffic 



37 



is fully blocked. This configuration can be set up independently by the source nodes, and is 
preferable to other loop-free startup configurations, since it does not cause any potential transient 
overload on any link inside the network. Due to the fact that the RT algorithm outputs a loop- 
free configuration if the input routing graph is loop-free [2], we can assert that at all iterations, 
the CR algorithm yields loop-free updates. Next, we note that CR{-) is fully supported by the 
marginal-cost-message exchange protocol introduced after the algorithms in Section IV-A[ since 
the only extra measure is ^(pwb, which is obtainable locally at the source node. 

VIII. Numerical Experiments 

In this section, we present the results of numerical experiments which point to the superior 
performance of the node-based routing, power allocation, and power control algorithms presented 
in Sections |Vl First, we compare our routing algorithm with the Ad hoc On Demand Distance 
Vector (AODV) algorithm [20] both in static networks and in networks with changing topology 
and session demands. Next, we assess the performance of the power control (PC) algorithm 
when the power control messages are propagated only locally. Finally, we test the robustness 
of our algorithms to noise and delay in the marginal cost message exchange process. For all 

F- 

experiments, we adopt Dij = (j. ,!!p_. as the link cost function. 

A. Comparison of AODV and BRT in Static Networks 

We first compare the average network cosj^ trajectories generated by the AODV algorithm and 
the Basic Routing (BRT) Algorithm (l42l)-(|43l) under a static network setting. We also compare 
the cost trajectories of AODV and BRT when they are iterated jointly with the Basic Power 
Allocation (BPA) and Power Control (PC) algorithms. The trajectories in Figure |4] are obtained 
from averaging 20 independent simulations of the AODV, BRT, BPA and PC algorithms on the 
same network with the same session demands. For each simulation, the network topology and 
the session demands are randomly generated as follows. 

For a fixed number of nodes = 25, let the N nodes be uniformly distributed in a disc of unit 
radius. There exists a link between nodes i and j if their distance d{i,j) is less than 0.5. The path 
gain is modelled as Gij = d{i,j)^^. We use capacity function Cij = \og{K ■ SINRij), where K 
represents the processing gain. In our experiment, K is taken to be 10^. All nodes are subject to 
a common power constraint Pi < P = 100 and AWGN of power Ni = 0.1. Each node generates 
traffic input to the network with probability 1/2, and independently picks its destination from the 
other A^ — 1 nodes at random. In the experiments, we assume all active sessions are inelastic, each 
with incoming rate determined independently according to the uniform distribution on [0, 10]. 

'^Recall that the network cost is the sum of costs on all links. 
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Fig. 4. Average cost trajectories generated by AODV and BRT with and without BPA and PC. 



When the AODV and BRT algorithms are iterated without the BPA and PC algorithms, we let 
every node transmit at the maximal power P and evenly allocate the total power to its outgoing 
links. As we can see from Figure IH since AODV always seeks out the minimum-hop paths for the 
sessions without consideration for the network cost, convergence to its intended optimal routing 
takes only a few iterations^ while the BRT algorithm converges only asymptotically. However 
in terms of network cost, BRT achieves the fundamental optimum and it always outperforms 
AODV. The performance gap between the AODV and BRT algorithms is significantly reduced 
by the introduction of the BPA and PC algorithms. In fact, the performance gains attributed to 
the BPA and PC algorithms are so significant that using AODV along with BPA and PC yields 
a total cost very close the optimal cost achievable by the combination of BRT, BPA and PC. 



B. Comparison of AODV and BRT with Changing Topology and Session Demands 

We next compare the performance of the AODV and the Basic Routing Algorithm in a quasi- 
static network environment where network conditions vary slowly relative to the time scale of 
algorithm iterations. In particular, we study the effects of time-varying topology and time-varying 
session demands. 

For each independent simulation, the network is initialized in the same way as the previous 
experiment. After initialization, the network topology changes after every 10 algorithm iterations. 
At every changing instant, each node independently moves to a new position selected according 

"in all our simulations, one iteration involves every node updating its routing, power allocation, and power control variables 
once using the corresponding algorithms. 
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to a uniform distribution within a 0.1 x 0.1-square centered at the original location of that node. 



We assume that the connectivity of the network remains unchanged!!^ so that the movement 
of nodes only causes variation in the channel gains {Gij}. Figure \5\ shows the average cost 
trajectories generated by AODV and BRT with and without the power algorithms, under the 
same topology changes. It can be seen from the figure that, relative to AODV, BRT adapts very 
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Average Cost for AODV and BRT under Changing Topology (N=25) 
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Fig. 5. Average cost trajectories generated by AODV and BRT with and wittiGut BPA, PC under ctianging topology. 



well to the time-varying topology. It is able to consistently reduce the network cost after every 
topology change. In the long run, BRT closes in on a routing that is almost optimal for all minor 
topology changes produced by our movement model. In contrast, AODV is not perceptive to the 
changes since it uses only hop counts as the routing metric. As a result, the routing established 
by AODV is never re-adjusted for the new topologies, and it yields higher cost than the routing 
generated by BRT. However, the performance of AODV with BFA and PC is virtually as good 
as BRT with BR\ and PC. Since the power algorithms are highly adaptive to topology changes, 
they almost completely make up the inability of AODV to adapt to topology changes. 

Figure [6] compares the performance of AODV and BRT under time-varying traffic demands. 
After the sessions are randomly initialized (in the same way as above), we let the session rates 
fluctuate independently after every 10 iterations. At each instant of change, the new rate of a 
session w is determined by = a^rw where the random factor is uniformly distributed 
from to 2, and is the original rate of w. Again, BRT exhibits superior adaptability compared 
to AODV. BRT tends to establish a routing almost optimal for all traffic demands generated by 

'**This is reasonable because nodes are assumed to randomly move within their local area. 



40 



Average Cost for AODV and BRT under Changing Traffic (N=25) 
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Fig. 6. Average cost trajectories generated by AODV and BRT with and without BPA, PC under changing traffic demands. 

the above random rate fluctuation model. On the other hand, the advantage of BRT over AODV 
becomes less evident when they are implemented together with the BPA and PC algorithms. 

C. Power Control with Local Message Exchange 

One major practical concern for the implementation of the Power Control (PC) algorithm (|53] ) 
is that for every iteration it requires each node to receive and process one message from every 
other node in the network (cf. Sec. IV-C.ll) . As a result, the PC algorithm, when exactly imple- 
mented, incurs communication overhead that scales linearly with A^. On the other hand, extensive 
simulations indicate that the PC algorithm functions reasonably well even with message exchange 
restricted to nearby nodes. One can understand this phenomenon intuitively by inspecting the 
formula for the marginal power control cost (|55] ). Note that the power control message from 
node n is multiplied by Gin on the RHS (|55] ). Thus, for n far from i, the contribution of MSG{n) 
to is negligible due to the small factor Gin- 

In the present experiment. The network and sessions are generated randomly in the same 
way as before. The routing is fixed according to a minimum-hop criterion, and all nodes 
uniformly allocate power on its outgoing links. We implement different approximate versions of 
the PC algorithm where the power control messages are propagated only locally. Each version 
of PC calculates the marginal power control costs S^^i approximately by using power control 
messages from a certain number of neighbors of i. To be specific, the exact formula (1551) is now 
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approximated by 

where A/'(i) is the subset of nodes that are closest to i. The size of A/'(i) varies from 1 to 8 for 
different versions of PC simulated in this experiment. The network and sessions are generated 
randomly in the same as before. Figure |7] shows the cost trajectories obtained from averaging a 
number of independent simulations. For example, the dotted line represents the cost trajectory 
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Fig. 7. Average cost trajectories generated by PC with different message exchange scopes. 



generated by the PC algorithm that approximates the marginal cost 6-yi using MSG{j) only 
from the node nearest to i. Results from Figure U\ indicate that as long as the computation of 
5'ji incorporates messages from at least two nearest neighbors, the performance of PC is almost 
indistinguishable from that of PC with complete message exchange. 



D. Algorithms with Delayed and Noisy Messages 

Finally, we simulate the joint application of the routing, power allocation, and power control 
algorithms in the presence of delay and noise in the exchange of marginal cost messages. 
We model the delay resulting from infrequent updates by the nodes. Specifically, we let each 
node i update routing message using (|24|) only when it iterates RT{<p^{w)), and we 

let node i update power control message MSG{i) using (l56l) only when it iterates PCi^ji). 
As a consequence, the marginal costs 5(j)ij{w) and 7^ have to be computed based on outdated 
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information from other nodes, as that information was last updated when the other nodes last 
iterated. 

In addition to delay, we assume messages are subject to noise such that the message received is 
a random factor times the true value Each message transmission is subject to an independent 
random factor drawn from a uniform distribution on [1 — NoiseScale, 1 + NoiseScale] where 
the parameter NoiseScale is taken to be 0.9 in the simulations shown in Figure [8l Compared to 
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Fig. 8. Average cost trajectories generated by BRT, BPA and PC witli delayed and noisy vs. perfect messages. 



using constantly updated and noiseless messages, the algorithms with delayed and noisy message 
exchange converge to a limit only slightly worse than the true optimum. 

In conclusion, the simulation results confirm that the BRT, BPA and PC algorithms have fast 
and guaranteed convergence. Moreover, they exhibit satisfactory convergence behavior under 
changing network topology and traffic demands, as well as in the presence of delay and noise 
in the marginal cost exchange process. In particular, the PC algorithm performs reasonably well 
when power control messages are propagated only locally. All these results attest to the practical 
applicability of our algorithms to real wireless networks. 

Finally, we note that the power allocation and power control accounted for most of the cost 
reduction when the performance of RT with BPA and PC was compared to that of AODV with 
BPA and PC. This points to the importance of jointly optimizing power control and routing, 

"The multiplicative noise is attributed to, for instance, errors in estimating the state of the fading channel over which marginal 
cost messages are sent. 
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and suggests that implementing the power allocation and power control algorithms jointly with 
existing routing algorithms can result in large performance gains. 

IX. Conclusion 

We have presented a general flow-based analytical framework in which power control, rate 
allocation, routing, and congestion control can be jointly optimized to balance aggregate user 
utility and total network cost in wireless networks. A complete set of distributed node-based 
scaled gradient projection algorithms are developed for interference-limited networks where 
routing, power allocation, and power control variables are iteratively adjusted at individual nodes. 
We have explicitly characterized the appropriate scaling matrices under which the distributed 
algorithms converge to the global optimum from any initial point with finite cost. It is shown 
that the computation of these scaling matrices require only a limited number of control message 
exchanges in the network. Moreover, convergence does not depend on any particular ordering 
and synchronization in implementing the algorithms at different nodes. 

To enlarge the space of feasible controls, we relaxed the high-SINR assumption for SINR- 
dependent link models by using the precise capacity function for the problem of jointly opti- 
mizing routing and power allocation. We further extended the analytical framework to consider 
wireless networks with general convex capacity region and strictly quasiconvex link costs. It 
is proved that in this general setting, an operating point satisfying equilibrium conditions is 
Pareto optimal. Next, we showed that congestion control can be seamlessly incorporated into 
our framework, in the sense that the problem of jointly optimal power control, routing, and 
congestion control can be made equivalent to a problem involving power control and routing 
in a virtual wireless network with the addition of virtual overflow links. Finally, results from 
numerical experiments indicate that the distributed network algorithms have superior performance 
relative to existing schemes, that the algorithms have good adaptability to time-varying network 
conditions, and that they are robust to delay and noise in the control message exchange process. 
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Appendix 

A. Proof of Lemma [7] 

Multiplying both sides of (l24l) for i = 0{w) hy r^j and summing over all w E W, we have 
dD 



dro(w){w) 



[^0{w)k, ^0{w)k) + 



fo{w)k{w) \ {Co{w)k-, Fo{ui)k) 



weA> k(^0{0(w)) 



dFo{w)k 



0{w)k 



+ 5Z foiw)k{w)(f)kj{w) 

wew keO{o{w)) jeO{k) 



drk{w) 



dD 



dFkj 



kj) 



drj{w) 



Expand the term repeatedly until j = D{w), where = 0. Then, use the flow 

conservation relation tk{w) = Yl,iex(k) fik{w) for k ^ 0{w) to successively factor out terms 
tk{w)(f)kj{w) = fkj{w). Finally, noticing that the outermost summation yields 



ik 



we obtain the equality of the LHS and RHS of (1341) . 



□ 



B. Proof of Lemma |2] 

For simplicity, we suppress session index w and iteration index k. For i ^ D{w), the entries 
of corresponding to subspace ji^^ : J2jeAJ\fi % ^ '^j follows. For k,j E AM-i, 

kk 



H. 



0, 



0?. 



tf 



+ 



dFl 



drl 



(85) 



kj d(t)ikd(t)ij ' drkdrj 



o2 r~i 

Note that the terms „„a''° are locally measurable. Thus, in the following, we deal only with the 
for k,j E AMi. In [3], the authors provide the following useful expression: 



terms 



dr'i 



and 



drkdrj 



drkdrj 



^ qmnik)qmnij) 



(86) 

{rn^n)££ 

where qmn{k) denotes the fraction of a unit flow originating at node k that goes through link 
{m,n). By the Cauchy-Schwarz Inequality, 



drkdrj 



< 



dr'i dr'j 



(87) 
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Multiplying on the left and right with non-zero vector Vi, we have 



<t 



< t 
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jeAAfi 
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j,keAJ\fi 
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drjdrk 
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drj 
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(88) 



-1] ■ 



E 



+ \AM, 




<t>i 



where the last inequality follows from applying the Cauchy-Schwarz Inequality to the inner 
product of vector (i/^xl^DjeAA/'i with the all-one vector of the same dimension. Thus, the 



Hessian matrix is upper bounded by the positive definite matrix ti ■ i?^., where 



H^. = diag 



dF^- 



I AAA, 



dr'j 



Note that \ANi\ is the non-blocked out-degree of node i at the current iteration. Also, note that 
5^ and are evaluated at X(j)\ + (1 - A)0f+^ = (fi'^ for some A e [0, 1]. 

ij 3 

There are various ways of producing approximate upper bounds on the diagonal terms in if^.. 
Bertsekas et al. [3] propose a message propagation scheme in the network where the propagated 
messages are upper bounds of ^ calculated by the corresponding nodes using the bounds 
provided by their downstream nodes. Such information exchange can be implemented in the 
same manner as that used for propagating the first derivative cost information 

To limit communication and computational complexity in wireless networks, we present 
another scheme which requires less overhead but nevertheless yields reasonable bounds. Let 



^ mn 



We have 



{m,n) 



n 

2 J-^inii 



dF^ 



(m,n) (m,n) 

To prove the last inequality, we focus on paths connecting j and D{w) induced by any loop-free 
routing pattern. Denote the collection of such paths by Vj and let 5p be the increase of path flow 
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on p G Vj as the result of a unit increment of input at node j. Thus, we have ^p^-p^ <5p = 1 and 
Summing over all {m,n), we obtain 

{m,n) {m,n) p(i'Pj:{m,n)(ip P^^'Pj {'m,n)£p P^'Pj 

where hj (p) is the number of hops on path p and hj = maxp^p. hj (p) . 

Now since the initial network cost is no greater than and the cost is strictly reduced with ev- 
ery iteration of RT{-) until conditions (|29l)-(l30l) are satisfied, for two consecutive steps k and k + 
1, on any link (m,n), D^„(C^„, < and /^mnlCn^^, F^n)li._=^_(0fe+i) < 

■mni Fmn)\ p —p ("Wi*'^"! 

a2n . . ^ 



By convexity of the cost function, DmniCmn, Fmn)\p =p (^^ft.^-i < for all A G [0, 1]. 



Therefore by the definitions of and A, we have A < A{D^). Also ^ 



Aij{D^) for the same reason. Putting all these results together, we can further upper bound 
■ H^. by 

edmg{{A,{D') + \AM,\h,A{Do))^^^^]. 
Thus, the proof is complete. □ 



C. Proof of Lemma \3\ 

Constrained in Vr,-, the transmission powers, hence the capacities, of node i's outgoing links 
are subject to change. We can therefore focus on Cij for j G 0{i) and take it as a function of 



= C{SINRij) = C 



CrijPif]ij 



Cij {r]i^ 



It can be seen that the Hessian matrix i/^'^ is diagonal. Omitting the superscript (fc, A), we can 
write the diagonal terms as 



n 2 



da, 



Because rjij must be lower bounded by rf. . > for which Dij{Cij{T].^), F^j) = D^, we have 



'lit > V - and x^-^ is bounded as 



J2m^i CmjPm + Nj 



X- 
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Thus, by dropping the negative term 2^P-C' {xij)xfAl + Xij) and recalling the definition of [3, 



in (1491 ). the diagonal term can be bounded as 



1 



max {C'{xfx\l + xf} + ^ , min {C" {x)x\l + xf) 

IJ ij — — zj I'J ij — — ZJ 



Therefore, the lemma follows. 
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D. Proof of Lemma |4] 

For brevity, we suppress the superscript (k, A) wherever it arises. The Hessian matrix under 
consideration has diagonal terms 
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The off-diagonal terms of the Hessian are 
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V (C ^2^2 (, Gi,{l-m,)Pi \ -G 
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Construct the following vectors for each i e J\f. 
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Thus, for any nonzero vector v e Rl^ I we have 
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E_dDrnj_ 

{m,j)(iS 



To get a simpler upper bound, notice that ^1 — '^*^^]^^'/^^' ^ < 1, < 1, and by 

assumption < 0, C^jX^ - + C'^jXmj < 0, the whole summation in the curly bracket can 
be bounded by 

Due to the peak power constraint, there exists a global upper bound on the achievable SINR 
on all links, that is x > max(^m,j)€£ ^mj- Recall the definitions for k, Lp, B{D'^), and B_{D^): 
K = maxo<:r<5;(C'(a;))^ ■x'^, ip = mino<:E<5; C"{x) ■ x^. 
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B{D ) = max max 
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We obtain 
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i.e., is upper bounded by |7V||^| [B{D^)k + MiD^)^] diag{(^2) }. □ 



E. Proof of Lemma |6| 

For convenience, we suppress the index k and parameter A. Using the precise capacity formula 
(|6T| ). we derive the entries the Hessian matrix as 
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Plugging the expressions (l64l)- (|66l) . we further bound the diagonal terms of Hrj. as 

[H^^]^^ < [B,AD^)K' - B,^{Df) {K - if] NR^ 
Thus, the proof is complete. 



□ 
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